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ABSTRACT: The purpose of the paper is to give a pedagogical introduction to the 
multiple time-scale technique, on the example of the high friction limit of the Kramers 
equation. We begin with a discussion of the standard perturbation technique as presented 
in van Kampen's reference book , which will be shown to fail in the long-time limit. 
Application of the multiple time-scale technique avoids these difficulties and leads to a 
uniform expansion in powers of the inverse of the friction. Analogy with the Chapman- 
Enskog expansion is discussed. 
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I. INTRODUCTION 

From a pedagogical point of view, the theory of Brownian motion is of fundamental 
interest in a graduate course on Statistical Mechanics. Starting with quite simple assump- 
tions, a microscopic stochastic model - namely the Langevin model - can be introduced to 
describe the thermal motion of the suspended Brownian particles. It is noteworthy that 
this simple treatment contains already all the basic features of non-equilibrium thermo- 
dynamics, such as diffusive motion, fluctuation-dissipation theorem, Einstein relation be- 
tween mobility and diffusion and the Green-Kubo relation for the diffusion coefficient ^ K . 
A complete description requires however a more precise characterization of the stochas- 
tic processes involved in Brownian motion, culminating in the Fokker-Planck evolution 
equation for the probability distribution of the Brownian particle VK,DGM _ ^wo l eve l s Q f 
description can be used. First, if both the velocity and position of the particle are consid- 
ered, the probability distribution P(r, v, t) evolves according to the Kramers equation 



d ^ .F(r) ^ 



P(r, v, t) = £V V .{ (v + ^V v )p(r, v, t) 



(1) 



where M denotes the mass of the Brownian particle, £ the friction, kgT the bath temper- 
ature and ^"(r) an external force field. This description was first given by Klein ^ em21 
and Kramers KramersAQ ^ Q n other hand, if only the spatial evolution of the particle is 
considered, one may rather use the Smoluchowski equation, governing the time evolution 
of the probability density p(r, t) in configuration space : 

9 -A^t) = -^7vJk B TV F -F(r))p(r,t) (2) 



This description, first put forward by Smoluchowski Smolu1 ^^ predates that of Kramers 
and Klein. 

However it took a long time to clarify the link between both descriptions. Kramers 
KramersAQ a [ reac |y pointed out that the Smoluchowski description should be obtained from 
the Kramers equation in the high-friction limit. This can indeed be intuitively understood 
: if the friction is high, the velocity relaxes after a short time, of order l/£, and the evo- 
lution on larger time scales is only determined by the spatial distribution. However, a 
rigorous perturbative derivation of the Smoluchowski equation from the Kramers one was 
given by Wilemski only in 1976 Wilemski7& ^ Another systematic expansion procedure was 
later suggested by Titulaer Tttulaer7 &. The latter is closely related to the Chapman-Enskog 
perturbation scheme to solve the Boltzmann equation^ erci5nam . This method is indeed 



natural in the present case, in view of the formal analogy between the collisional terms oc- 
curing in the Boltzmann and in the Kramers equations. In both equations, the right-hand 
side characterizes the effect of collisions on the time evolution of the distribution function. 
The singular nature of the expansion is due to the presence of the small parameter l/£ 
(replaced by the Knudsen number in the case of the Boltzmann equation) multiplying the 
time derivative in the Kramers equation. This makes a straightforward application of the 
perturbation theory impossible. In his reference textbook VK (pp. 234-236) , van Kampen 
proposes an alternative, pedagogical method, which is closer in spirit to the Hilbert per- 
turbation scheme Cerci 9 nam _ This procedure leads indeed to the Smoluchowski equation. 
The purpose of this paper is to show that this pedagogical approach is however incomplete 
and leads to inconsistencies in the expansion procedure. In section II, we will show that 
hidden secular terms are present in this description, which diverge as time goes to infinity. 
These terms make the asymptotic expansion non-uniform in the small parameter l/£. In 
section III, we propose an alternative approach, based on the multiple-time scale method. 
This procedure eliminates the secular divergences and construct a uniform expansion in 
the small parameter (the inverse friction in our case) Na vf e h_ The multiple time-scale 
method allows one to recover quite easily all the features of the Chapman-Enskog proce- 
dure of Titulaer r*^ aer 78 Moreover, it gives a clear interpretation of the contribution of 
all orders in 1/^ in the time derivative, as it is formally introduced in the Chapman-Enskog 
expansion'- 767,0 * 5 ™™ . 

II. THE HILBERT EXPANSION 

In this section, we first reproduce and then discuss the expansion procedure as given 
in van Kampen's reference book, in order to point out the limitation of this "Hilbert" 
perturbation scheme. We will restrict ourselves to the one-dimensional case to simplify the 
analysis. 

First, we introduce new dimensionless variables 

r = t^; V = —- X = - n - F = T-Ly (3.a) 

and a dimensionless friction 

id = e- (3.6) 

where = \fk^TjM is the thermal velocity and t is a characteristic length scale of the 
system (such as the Brownian particle diameter). The Kramers equation then takes the 
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following form 



3 3 3 



P(X, V;t) 



Let us insert into (4) the "naive" expansion 

p = p(°) + i d x p« + if p^ + ... 

By identifying terms of the same order, we find the following equations 

C FP p(°) = 

P (0) 



C FP P(!) 
C FP P( 2 ) 



3 3 3 

a~r +v ax + F ^W 

3 3 3 
3t +V 3X +F ^3V 



p(i) 



(4) 



(5) 



(6) 



where we introduced a "Fokker-Planck" operator defined as 



FP 3V\ 3V 



The zeroth order equation imposes a maxwellian velocity distribution 

p(°)(X,y;r) = $(X;r)e- 1 ^ 2 

and the function $ has to be determined. 



The first order term then gives 



C FP PC 1 ) 



1h 



3X 



-F $ \e 



-1/2V 2 



By integrating both sides over V, one obtains a "solubility condition" 



3t 







(7) 



(8) 



(9) 



(10) 



This can be understood in terms of linear algebra. The eigenfunctions of C FP are the 
functions H n (V/y/2) exp(— where H n is the n-th Hermite polynomial. Since the 
Maxwellian is associated with a null eigenvalue, the orthogonality between the eigenfunc- 
tions imposes that all terms multiplying the maxwellian on the right hand-side (r.h.s.) of 
equations like (9) must be vanish. This is precisely the "solubility condition" (10). 
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Equation (9) can now be solved to yield 

PW{X, V;t) = -V {H - F d>} e- l ' 2y2 + rje" 1 ^ 

where \1/ has to be determined. 

By inserting this solution into (6), one obtains 



(11) 



C FP P< 2 > = { 



— < F 



d 




dX 


\dX 




-F $ 


dX 



e 

d fd® 



dX 



dX 



(12) 



where the terms have been grouped into Hermite polynomials H n (V/y/2). According to 
the solubility condition, the first term in the r.h.s. of (12) must be set to zero, so that 



dr dX \dX 



F $ = 



(13) 



Following van Kampen, one can then collect the results to obtain the distribution function 
to order : 



P(X,V;r) = e 



-1/2V 2 



" & v ( dx ~ F * ) + r) + ° { ^ 2 ) 



(14) 



After integrating over the velocity, one obtains the spatial probability density p(X; r) as 

p(X; r) = V^ [*(X) + ^(X; r) + 0(Q 2 )] (15) 
and eq. (13) then yields the (dimensionless) Smoluchowski equation 

However, a careful inspection of eq. (13) shows that \& diverges as time goes to infinity. 
Indeed, eq. (10) shows that $ is independent of time. Then, the first term in (13) does 
not depend on time either and the function \1/ is proportionnal to time r 



#pT;r) ~ r 



(17) 



The standard expansion (5) of the solution thus leads to secular divergences and cannot 
be correct in the long time limit. In other words, a naive expansion is not uniformly 
convergent for small 1/Cd- The limit of time going to infinity cannot be inverted with 
the limit of friction going to infinity, so that taking small corrections in into account 
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leads to an upper bound for the time r. In fact, this procedure implicitly expands time 
dependent terms like r/id as ^J 1 terms, and secular divergences appear in the long-time 
limit. 

III. THE MULTIPLE TIME-SCALE APPROACH 

In the limit — > 0, the Kramers argument presented above indicates a time-scale 
separation. There is first a very short period (t ~ during which the velocity of the 
Brownian particle thermalizes. Then the dynamical evolution is controlled by the time- 
dependence of the spatial distribution on longer time-scales. This separation of time-scales 
in the limit — > suggests the application of the multiple time-scale analysis. This 
method replaces the physical distribution function P(X, V; r) by an auxiliary function, 
P{X, V; ro, 7~i, T2, . . .), depending on several time-scales. Accordingly, the time derivative 
in the physical evolution equation (4) is replaced by the sum of time derivatives on each 
time-scale, 

d^^d7 + ^ d d7i + ^ d d7 2 + '" ( } 

The auxiliary distribution function P(X, V; tq, t\, T2, ■ ■ ■) is then expanded in powers of 
the small parameter if and inserted into the evolution equation, where terms of the 
same order are identified. The physical solution of the system is eventually obtained by 
restricting the different time variables to the so-called "physical line" 

r = r ; n = i d 1 t ; r 2 = £ d 2 t ; ... (19) 

so that 

P(X, V- t) = P(°)(X, V- r, i d l r, if r, . . .) + Q 1 P^(X, V; r, & r, if r, ...) + .. . 

(20) 

will be the solution of the Kramers equation (4). Equation (19) indicates that the de- 
pendence of the distribution function on r n characterizes the evolution on the time-scale 
r~# (n = 0,1,2,...). 

The crucial difference with the standard perturbation method is that outside the physi- 
cal line (19), the auxiliary distribution function has no physical meaning. Then appropriate 
boundary conditions can be imposed to require the expansion to be uniform in the small 
parameter ^J 1 . This freedom will be used to eliminate secular divergences. 

The identification of different powers of if in the Kramers equation gives the following 



relations 



C FP p(°) 



= 



p(0) 

P (i) + 



<9ti 



p(0) 



(21) 



The zeroth order equation still imposes a maxwellian velocity distribution 

P(°)(X, V; r , n, . . .) = $(X; r , n, . . Oe- 1 ^ (22 ) 

where the function $ now depends on all time variables. 

The first order term thus obeys to the following equation 

C FP P« = f^e-V^ + v |H _ p * J e -V2^ (216) 
The solubility condition then requires the function $ to be independent of the to time-scale 



dr 



= 



(226) 



and the first correction for the distribution function is now given by 

PW(X, V; r , n , ...)=- V { ggtj^M _ F T1 , . . .)} e -l/*V ^ 

+ *(X;T ,n,...)e- 1/21 ' 2 

The equation for p( 2 ) becomes 



/ I || - F *1 - A ("II _ p $ ) Ul _ V 2) e -W 



OX 



OX \dX 



The solubility condition then requires 



9tq 



dri dX \dX 



_p $ 



(24) 



(25) 



The r.h.s. of this equation does not depend on tq (see eq. (22b)), and one must impose 
the condition 



to eliminate the secular divergence as tq grows to infinity. This leads to a closed equation 
for $ 

- -tLl t^L - F =o (27) 
dri 8X \dX ) K ' 

This result has to be compared with eq. (f 3) of the standard Hilbert procedure, where the 

time-dependence of the density was only contained in the first order correction (through 

see eq. (15)). A correct expansion thus modifies the perturbative scheme and leads to 

different couplings between the successive corrections to the probability distribution. 

The physically relevant equation for p is then obtained by restricting the different 
variables to the physical line (19). The time derivative of p can now be written 



^-p(X, r) =v^^ [<&(*; n, • • •) + tfvfr ri, • • •) + 0{i d 2 ) 

+ ^v 7 ^^- [<&(X; n , . . .) + £J %(X; n, . . .) + 0{i d 2 ) 



id " dri 



- \T0=T,Tl=T/£ d ,... 

t =t,ti=t/^,... 



(28) 

Using (27) and (15), we eventually recover the (dimensionless) Smoluchowski equation 

IV. DISCUSSION 

Let us make a few remarks on the present derivation. 

First, as mentionned in the introduction, the Smoluchowski equation governs the spa- 
tial evolution of the Brownian particle. This evolution is then expected to occur on a 
diffusion time scale tjj ~ £ 2 /D, where D = kj^T/M^ is the diffusion coefficient, or in 
dimensionless variables, tjj = ^y^d ~ £d- This feature emerges in a natural way from the 
multiple time scale analysis. Indeed, according to equation (27), we have shown that the 
spatial density probability evolves on the t\ time scale, which precisely characterizes the 
evolution of the system on time scale r ~ £^ ~ T£> (see discussion after equation (20)) ! 

As indicated above, the t 3> limit of _p(°) is just the Maxwellian, which can be 
interpreted here as the "local equilibrium approximation" of the Fokker-Planck operator, 
Cpp. As shown in eq. (22b), this solution does not evolve on the time-scale tq, where 
this approximated form for p(°) remains valid. This property confirms the relevance and 
the deep physical meaning of the local equilibrium approximation, as a state of the system 
which exists over a large time-scale. 
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Finally, let us remark that the formal analogy between the Kramers equation and the 
Boltzmann's equation can serve as an introduction to perturbative expansion methods in 
Kinetic Theory. It should be noted that the multiple-time scale method is indeed very 
close in spirit to the Chapman-Enskog procedure. Indeed, the latter introduces an ad-hoc 
formal expansion of the time derivative in powers of the small parameter e 

dt ^ dt v ' 

n=0 

(in Kinetic Theory, the Knudsen number is the small parameter). This is a subtle point of 
the procedure, which stems from the expansion in powers of e of the functional dependence 
of the distribution function on the "hydrodynamic" fields Tt t ula er78,Cerctgnam _ rp^g eX pli c it 
expressions for the operators d( n '/dt are computed in the course of the calculation thanks 
to solubility conditions. Equation (30) is formally equivalent to the multiple time-scale 
expansion of the time-derivative (18). In this sense, the application of the operator /dt 
of the Chapman-Enskog method characterizes the dynamical evolution of the system on 
the time-scale t ~ e~ n . For the purpose of a pedagogical approach, the multiple time-scale 
approach seems however more natural to us, since it gives a clear understanding of each 
term of the expansion. Moreover it explicitly shows the crucial importance of e dependent 
corrections in the time derivative (30) to obtain a consistent expansion. Absence of such 
terms would inevitably lead to inconsistencies identical to those occuring in the naive 
expansion of the Kramers equation. 

To conclude, the study of the Kramers equation in the high friction limit gives a peda- 
gogical and instructive presentation of the multiple time-scale method. Pedagogical, since 
it can be shown explicitly that the method avoids all the troubles of more naive pertur- 
bation expansions; instructive, since it allows a deep insight into the underlying physics. 
This technique has already been successfully applied to a variety of problems in physics 
Nayfeh^ suc j 1 as ^he Lorentz model Jarek ? adiabatic systems Anderson Qr a m i crosc0 pi c ( ex _ 
act) approach to Brownian motion Boc( i uet to cite some recent work. For such complicated 
situations, it describes in a systematic way the dynamical evolution of the system on each 
successive time-scale. This property constitutes the real power of the method. 
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